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This paper considers several methods for the efficient coding of 
two-level pictures dithered to give the appearance of multiple ampli- 
tude levels. In the dithering technique, a multilevel image signal is 
compared with a position-dependent set of thresholds (called a dither 
matrix), and, if the image value exceeds the threshold, the two-level 
output signal is taken to be "white," otherwise it is taken to be "black." 
Spatial correlation present in the original image is not preserved in the 
two-level picture due to spatial variation of the value of the threshold; 
and, therefore, standard techniques for coding two-level pictures, such 
as run-length coding, lose their efficiency. We show how some of our 
recently developed techniques for coding two-level pictures can be 
modified to code two-level dithered images. Our computer simulations 
on a few representative two-level dithered pictures indicate that an 
entropy between 0.2 to 0.3 bit/pel is possible using our technique. A 
comparison with some recently proposed techniques by Judice indi- 
cates that those schemes result in about 10 to 60 percent higher entropy 
than our schemes. 



I. INTRODUCTION 

Techniques for representing the entire gray scale of a picture by only 
two levels have been receiving considerable attention 1-10 because many 
devices are limited to recording or displaying two-level signals. Although 
these techniques may differ in specific algorithms, they provide the 
subjective illusion of a wide range of gray shades by controlling the 
proportion of picture elements in a neighborhood that are in the "on" 
state. 

One of the techniques (called "dither" and studied in detail by Limb, 2 
Lippel and Kurland, 3 and Judice et al. 9-10 ) consists of comparing the 
multilevel input image signal with a position-dependent set of thresholds 
and setting only those picture elements to "white" (or 1) where the image 
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Fig. 1 — A 4 by 4 dither matrix to be used for images with 8-bit quantized samples. 

input signal exceeds the threshold. A square matrix of threshold values 
(elements of a "dither matrix") is repeated as a regular array to provide 
a threshold pattern for the entire image. Subjective effects of gray shades 
are achieved by using a dither matrix. The 4 by 4 dither matrix used by 
Judice et al. 9 for an input image having gray levels between and 255 
is shown in Fig. 1. The values of the adjacent elements of the dither 
matrix were chosen to take advantage of the spatial low-pass filtering 
present in the human visual system and, at the same time, to reproduce 
edges accurately and to avoid objectionable patterns. When the input 
image intensity is compared with spatially varying thresholds, a large 
amount of spatial correlation present in the input image is suppressed. 
This loss of correlation in the dithered two-level image makes some of 
the standard methods of coding two-level signals, such as run-length 
coding, 11 inefficient. 

Several modifications of the standard techniques are possible. Judice 
has considered two such modifications. In one scheme, 12 called bit in- 
terleaving, runs of picture elements corresponding to equal or near equal 
elements of the dither matrix are coded using standard techniques. The 
other scheme, 13 called pattern matching, assigns a code to two-dimen- 
sional bit patterns of the dithered image and relies for bit-rate reduction 
on the fact that all possible bit patterns do not occur with the same fre- 
quency. 

In our schemes, the "state" of the coder when an element is to be coded 
is a function of the already transmitted values of surrounding elements 
and the dither threshold at the element to be coded. The value that 
minimizes the probability of prediction error conditioned on a state is 
the predicted value of the element to be coded. This is an extension of 
the predictive coding for two-level pictures discussed in Ref. 14. In one 
of our schemes, we code run-lengths of the prediction error. In- our other 
schemes, we change the relative order of the picture elements along a 
scan line in such a way as to increase the average run-length of the black 

810 THE BELL SYSTEM TECHNICAL JOURNAL, MAY-JUNE 1977 



and/or white elements and then transmit the run-lengths. These schemes 
are described in detail in Section 2.3. 

We have investigated the efficiency of our techniques by computer 
simulation on a few representative 4- by 5-inch pictures, scanned with 
an array of 512 by 512. Using run-length coding of prediction errors, it 
is possible to decrease the bit rate to about 0.22 to 0.42 bit/pel. "Good- 
bad" state ordering performs best among all the ordering schemes that 
we have considered, and it brings the bit rates down to between 0.20 to 
0.30 bit/pel. As a comparison, results from simulation of the same pic- 
tures by Judice show a bit rate of between 0.22 to 0.48 bit/pel. 

II. CODING ALGORITHMS 

In this section, we describe our coding algorithms in detail and present 
results of our computer simulations. The pictures used for computer 
simulation are shown in Fig. 2. These pictures were 4 inches by 5 inches 
and were scanned with 512 samples along a line and 512 lines. Each 
picture element was digitized by a uniform PCM coder to an accuracy 
of eight bits (256 levels). The digitized signal was dithered by using the 
dither matrix shown in Fig. 1. The coding algorithms were applied to the 
dithered images. As a measure of performance, we used the sample 
first-order entropy of run -length statistics. We computed the average 
black and white run-lengths and the entropy of black and white runs 
using, for example, the formula 

where E w is the entropy of white run-lengths, ni is the number of white 
runs of length i, and N is the total number of white runs. Using these, 
and eq. (1), we computed the entropy in bits/pel by: 

E _ E w N w + E b N b 
r w N w + r b N b 

Eg + E b 

= ; (when N w s N b ), 

r w + r b 

where 

E b is the entropy of the black run statistics (bits/run) 

r w is the average white run-length (pels/run) 

r b is the average black run-length (pels/run) 

N w , N b are the number of white and black runs, respectively 

E is the entropy in bits/pel. 

2. 1 Prediction algorithm 

Consider a dithered picture element Sy at position (i,j) where the 
dither matrix has value Dy. To develop a predictor for Sy, consider 
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Pig. 2— Dithered images used for computer simulation of coding algorithms, (a) Karen. 
(!)) Kngineering drawing, (c) House. 



surrounding elements W, X, Y, Z as shown in Fig. 3. Note that elements 
W, X, Y, Z and the value of the dither matrix D„ are known to the re- 
ceiver when decoding the signal at point (i,j). The state associated with 



Sjj is defined as the five-tuple 



Q= (Dij,W,X,Y,Z). 



(2) 



Since we are using a 4 by 4 dither matrix, Dy can have 16 different values. 
Each W, X, Y, Z can have two values, and, therefore, the number of 
possible states is 256. Let these be denoted by the set \Q k \, k - 1, -, 256. 
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W X Y 

LINEi-1 * K X- 



LINEi X (*) 

Z Sjj : PICTURE ELEMENT BEING CODED 

D ij: VALUE OF DITHER MATRIX ELEMENT 

Fig. 3 — Configuration for definition of state. 

Then a predictor code book is given by: 

C(Q k ) = "0" if P(Sij = "07Q = Q k ) ^ 0.5 

= "1" otherwise, (3) 

where C(-) is the predictor code book and P(-\-) is the experimentally 
determined conditional probability that a picture element has a value 
of "0" or "1" given the state Q k . Thus, the predictor thus depends upon 
the previously transmitted values in a neighborhood and some partial 
information about the present picture element known both to the 
transmitter and the receiver in the form of the value of the dither matrix. 
The code book can be designed for each picture and transmitted before 
actual picture transmission,* or it can be taken to be an average for a 
class of pictures. A portion of the code book for each of the three pictures 
that we considered is shown in Table I, where we assign the state number, 
k, by computing formula (4), and show the number of occurrences of each 
state and the probability of error. 

k = Dij + 8 W + 4X + 2Y + Z + 1. (4) 

We note that the probability of prediction being in error is always less 
than 0.5 due to our method of prediction. The code book defined by eq. 
(3) does vary from picture to picture. We examine the effects of such 
variation in a later section. 

2.2 Run-length coding of prediction errors 

In this technique, we code the run-lengths of the prediction errors 
along a scan line using the appropriate code book for each picture. The 
entropy of the run-length statistics is given in Table II. It varies between 
0.22 to 0.42 bit/pel. To evaluate the effects of the variation of code book 
with respect to pictures, we used the code book of one picture for the 
prediction of another. The resulting entropies of the run-lengths of 



* Only 256 bits are needed to transmit a code book; since there are (512) 2 picture ele- 
ments per picture, transmission of one code book per picture corresponds to an additional 
0.001 bit/pel. 
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prediction errors are also shown in Table II. As expected, when a code 
book is used that is not specifically matched to the picture, there is a loss 
of coding efficiency. However, by using the code book for the picture of 
Fig. 2a for all the pictures, there is a maximum loss of only 0.08 bit/pel. 
Thus, although better results in terms of entropy can be obtained by 
using a matched code book, it appears possible to use a general code book 
that will not degrade the performance significantly. 

2.3 Ordering techniques 

These ordering techniques are extensions of our techniques for two- 
level pictures. 15 In these techniques, we order either the elements or the 
prediction errors of the present line using a reference signal available 
to both the transmitter and the receiver — for example, the elements of 
the previous line. 

To illustrate the technique, consider a memory containing 512 cells 
(equal to the number of elements per line). Suppose the cells of this 
memory are numbered from 1 to 512. If the first element of the previous 
line is white, then we put the prediction error for the first element of the 
present line in memory cell 1; if the first element of the previous line is 
black, then we put the prediction error for the first element of the present 
line in memory cell 512. We continue in this manner: the prediction error 
of the ith element of the present line is put in the unfilled memory cell 
of smallest index or of largest index depending on whether the ith ele- 
ment of the previous line is white or black. When the memory is filled, 
its cells are read in numerical order and the contents are run-length 
encoded. It is easy to see that the present line can be uniquely recon- 
structed from the knowledge of the run-lengths of the ordered line, since 
the ordering information is known to the receiver. 

The efficiency of the simple ordering technique discussed above is 
given in Table II. It is seen that due to the process of dithering, much 
of the efficiency of ordering is lost. We overcome the effects of dithering 
by using an ordering technique based on the "goodness" of the state. 
We divide the states defined in eq. (2) into two groups. States that have 
a high probability of correct prediction are called "good" states and the 
remaining are called "bad" states. Our algorithms can be described as 
follows: we first evaluate the prediction error for a particular element 
of the present line, and then, if the state is "good," we put the prediction 
error in the unfilled memory cell with the smallest index; if the state is 
"bad," the prediction error is put in the unfilled memory cell with the 
largest index. Having ordered the prediction errors, we run-length code 
them as before. 

It is easy to see that the line of picture data can be uniquely recon- 
structed from the coded run-lengths of the prediction error. The en- 
tropies obtained by this scheme are given in Table II. The criterion of 
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"goodness" of a state is determined by a threshold on the probability 
of error. Our simulations indicate that a threshold of 5-percent proba- 
bility of error does better than thresholds of 2 percent, 10 percent, and 
20 percent for all three pictures. The entropy is reduced to between 0.20 
to 0.30 bit/pel. The advantage of ordering, obtained by comparing these 
entropies with those obtained from run-length coding of the prediction 
errors, is about 9 to 29 percent. We also considered the use of a prediction 
code book from Fig. 2 for all pictures. This resulted in a small increase 
in entropy over that obtained by using a matched code book. 



2.4 Comparisons with the algorithms of J u dice 

We mentioned earlier that Judice has recently given two algorithms 
for coding of dithered two-level pictures. In one of them, 12 runs of picture 
elements corresponding to the same values of the dither matrix are 
run-length coded. He has discussed this scheme in one dimension (called 
one-dimensional bit interleaving) as well as two dimensions (called 
two-dimensional bit interleaving). The bit rates obtained by these two 
schemes are reproduced from Ref. 12 in Table II. A bit rate of 0.22 to 0.48 
bit/pel is possible with these schemes. This is about 10- to 60-percent 
higher than the entropies obtainable from our "good-bad" state ordering 
schemes. The other scheme discussed by Judice et al., 13 called pattern 
matching, assigns a code to two-dimensional bit patterns of the dithered 
images. The entropies obtained in this case, also reproduced in Table 
II from Ref. 13, are generally higher than those achieved by two-di- 
mensional bit interleaving. Thus, our "good-bad" state ordering schemes 
perform more efficiently than the schemes proposed by Judice. 

III. DISCUSSION AND SUMMARY 

We have described schemes for efficient coding of dithered two-level 
signals. We started with the description of a predictor that depends upon 
already transmitted neighboring elements and the value of the dither 
matrix at the element being predicted. The predictor minimizes the 
probability of prediction being in error. We found that the run-length 
coding of the prediction errors brought the bit rate down to about 0.22 
to 0.42 bit/pel for the three pictures we used for simulation. We then 
discussed several ordering algorithms in which the relative order of 
transmission of the picture elements in a scan line is changed to increase 
the average lengths of black and white runs. We found that the ordering 
scheme based on goodness of the state decreased the bit rate to 0.20 to 
0.30 bit/pel. Finally, we compared our results with those obtained by 
Judice and found that his schemes gave about 10 to 60 percent higher 
entropy. 
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It should be mentioned that this is not a definitive coding system 
study. We have not considered many important factors crucial to the 
success of any coding system, such as run-length codes and their picture 
dependence, and the effect of transmission errors. 
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